Thermodynamic origin of order parameters in mean-field models of spin glasses 
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We analyze thermodynamic behavior of general n-component mean-field spin glass models in order 
to identify origin of the hierarchical structure of the order parameters from the replica-symmetry 
breaking solution. We derive a configurationally dependent free energy with local magnetizations 
and averaged local susceptibilities as order parameters. On an example of the replicated Ising spin 
glass we demonstrate that the hierarchy of order parameters in mean-field models results from the 
structure of inter-replica susceptibilities. These susceptibilities serve for lifting the degeneracy due 
to the existence of many metastable states and for recovering thermodynamic homogeneity of the 
free energy. 
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I. INTRODUCTION 

An effective spin exchange between magnetic impuri- 
ties diluted in a host metallic matrix is inhomogeneous 
and does not prefer either ferromagnetic or antiferromag- 
netic alignment of the impurity spins. It is hence natural 
to simulate such a magnetic behavior by a random dis- 
tribution of the spin exchange as introduced by Edwards 
and Anderson. 1 Frustration in the spin exchange induced 
by static randomness has since then become the hallmark 
of microscopic models of spin glasses. Due to complex- 
ity of spin-glass models, majority of theoretical research 
of spin glasses has concentrated on mean-field proper- 
ties of the Ising spin glass proposed by Sherrington and 
KirkpatrickrS* 3 Although we have by now a consistent 
comprehensive solution of the Sherrington-Kirkpatrick 
(SK) model in form of the replica-symmetry breaking 
(RSB) scheme of Parisi^ there remain a few issues where 
a conclusive answer is still pending. 

One of unsettling features in spin-glass models is the 
way the mean-field solution and its interpretation are ob- 
tained. On one hand, the replica trick and replicas of 
the spin variables are used to convert the static random- 
ness to a dynamical, thermal-like averaging and to offer 
a necessary space for introduction of symmetry breaking 
order parameters. They are overlaps between different 
spin replicas Q ab = N^ 1 J2*( S i S i)- The brackets denote 
joint thermal and configurational averaging. The phys- 
ical interpretation of the replica order parameters can, 
however, be reached only within a thermodynamic ap- 
proach where a mean-field free energy is first constructed 
for typical configurations of the spin-exchange. In this 
thermodynamic approach pioneered by Thouless, Ander- 
son and Palmer (TAP)^ we have only local magnetiza- 
tions rrii — (Si)T, thermally averaged local spins, as or- 
der parameters for the Ising spin glass. To complete the 
mean-field solution, a relation between the local magneti- 
zations from the TAP approach and the averaged replica 
parameters must be established. It was successfully done 
within the so-called cavity method with many metastable 
TAP states&£ 



The existence of a multiple of solutions to the TAP 
equations has been demonstrated both directly 8 ^ and 
also indirectly^2*ii Within the cavity method the pa- 
rameters q a/3 = N^ 1 J2i m ? m i \ overlaps between local 
magnetizations from different pure (metastable) states, 
were related to the RSB parameters Q ab . However, 
the order parameters from the RSB construction can 
generally be represented as Q ab 



q 



ab 



ab 



r.ab 



where 



A -1 J2i Tnfm b is the overlap of local magneti- 
zations between different spin replicas (should not be 
identified with different metastable states) and x ab = 
A" 1 J2i(i S i S t)T ~ mfml) is the local overlap suscepti- 
bility. It is just only the special case of the non-replicated 
Ising model (Sf = 1) where the overlap susceptibility in 
the TAP construction with a single equilibrium state can 
be expressed via local magnetizations. If we investigate 
vector spin glasses^ or assume the existence of many 
quasi-equilibrium states we cannot get rid of local sus- 
ceptibilities as independent order parameters. 

It indeed appears that the local magnetizations rrii of 
the TAP theory fail in determining unambiguously the 
equilibrium thermodynamic states. It has been demon- 
strated by numerical means that there is a macroscopic 
portion of configurations of the spin exchange for which 
we are either unable to find a stable solution of the TAP 
equations at low temperature o 8 ' 13 or we have paired sta- 
ble and unstable solutions with nearly the same energies>2 
It means that macroscopic parameters, temperature and 
external magnetic field, do not determine uniquely local 
magnetizations and it is unclear whether there is an equi- 
librium TAP state at all temperatures. In such a case the 
TAP free energy is no longer thermodynamically homo- 
geneous and solutions of the TAP equations depend on 
initial/boundary conditions. We have to introduce spin 
replicas and overlap local susceptibilities emerge as nat- 
ural order parameters^ 

The aim of this paper is to trace down the gene- 
sis of the order parameters Q ab from the RSB scheme 
within the thermodynamic TAP-like approach. In par- 
ticular, we analyze the role of local magnetizations m° 
with their averaged overlaps q ab and averaged local sus- 
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ceptibilitics X ab in the mean-field free energy of a general 
n-component spin-glass model with spin components S a , 
a = 1, . . . , n. We employ the replicated TAP theory from 
Ref. [Ij as the simplest example of an n-component spin 
model and find that not the local magnetizations and 
their averaged overlaps q ab , but rather the overlap local 
susceptibilities \ ah seem to be relevant order parameters 
in the spin glass phase. To demonstrate this we first an- 
alyze two real replicas of Ising spin variables. Using the 
replica-symmetric ansatz we then continue analytically 
the replicated TAP free energy to arbitrary replication 
factors to enable investigation of thermodynamic homo- 
geneity. We recover the one-step RSB solution of Parisi 
by minimizing thermodynamic inhomogeneity incurred 
by the imposed replica-symmetry. Conditions for global 
thermodynamic homogeneity and a way to reach a ther- 
modynamically homogeneous mean-field free energy are 
presented. 

The paper is organized as follows. We define in Sec. ITU 
the studied models being generally n-component spin sys- 
tems. Multi-component spin models can arise either due 
to the vector character of spins or due to replications of 
the phase space introduced to test thermodynamic ho- 
mogeneity. We sum in Sec IIIII mean-field thermal fluc- 
tuations for a typical configuration of the spin exchange 
before averaging over randomness. In Sec. II VI we analyze 
the case of two real replicas to demonstrate the impor- 
tance of the averaged local overlap susceptibility in the 
spin-glass phase. We analytically continue the replicated 
free energy from integer numbers of real replicas to arbi- 
trary replication factors in Section using the replica- 
symmetric ansatz. Stability conditions and a hierarchical 
construction of a globally homogeneous solution are pre- 
sented in Sec. |VTJ Finally in Sec. |W] we discuss the 
physical meaning of the order parameters in the repli- 
cated phase space and we summarize the conclusions in 
SecETU 



II. SPIN-GLASS MODELS AND 
THERMODYNAMIC HOMOGENEITY 



The Ising spin glass in its mean-field limit, the SK 
model, is degenerate in that the fluctuation-dissipation 
theorem allows us to exclude local susceptibilities from 
the order parameters of the configurationally dependent 
free energy. We hence will consider general vector spin 
models so as to assess better the role and importance of 
local susceptibilities in the mean-field thermodynamics 
of spin glasses. Our starting Hamiltonian reads 



H 



— ^ Jij Si ■ Sj H ■ ^ Si 



(1) 



The norm of the spin vectors is fixed and we assume 
for our purposes that it depends on the number of spin 



components n, that is 

n 

rt \ na na 



ns,. 



(2) 



We are interested in the thermodynamic limit of thermo- 
dynamic potentials of this Hamiltonian for fixed config- 
urations of the spin-exchange parameters Jy . The free 
energy reads 



F = 



-- lim lnTr s 

(3 TV— oo 



exp { I Yl • / '." v ' • s 'j 



N 



JV 



+I3H ■ Si 



i=l 



(3) 



The trace Trg is taken over all admissible spin configura- 
tion respecting the normalization condition . The free 
energy in Eq. is very general and covers vector spin 
models as well as replicated spin models that we will need 
for the investigation of thermodynamic homogeneity. 

Since the ordering part of the spin exchange is irrele- 
vant for our reasoning we assume only purely fluctuating 
frustrated spin exchange that in the mean-field limit has 
a long-range character and is a Gaussian random variable 
with 



(■I 



l 3 1 av 



= o, 



i 2 

(j 2 \ = — 



for i^j. (4) 



The mean-field models are peculiar in that they are 
long-range with a volume-dependent spin-exchange as in 
Eq. 10}. The volume-dependence just compensates for 
the infinite range of the spin exchange. Thereby the 
energy remains linearly proportional to the volume and 
we can expect that the mean-field solution emulates the 
thermodynamic properties of realistic models in a sense 
reliably or at least consistently. 

One of fundamental properties of thermodynamic sys- 
tems is thermodynamic homogeneity. It says that ther- 
modynamic potentials are products of the volume and 
functions where all extensive variables enter only via their 
spatial densities. Thermodynamic homogeneity is nor- 
mally expressed as the Euler lemma 



aF(T,V,N,...,X h ...) 



F(T, aV, aN,..., aX l 



(5) 



where a is an arbitrary positive number and the set {Xi} 
covers all extensive variables, the thermodynamic poten- 
tial F depends on. Only if this homogeneity condition is 
fulfilled by thermodynamic potentials we can prove the 
Gibbs-Duhem relation and the thermodynamic limit does 
not depend on the shape of the volume and on bound- 
ary/initial conditions. The simplest example of a ther- 
modynamically inhomogeneous systems is the classical 
ideal gas with distinguishable particles (Gibbs paradox). 
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Thermodynamic homogeneity is a consequence of in- 
variance of the thermodynamic limit of short-range mod- 
els with respect to scalings (contractions and dilata- 
tions) of the phase space. Since the spin-exchange in 
mean-field models is an extensive variable, it is not a 
priori evident whether also mean-field models should 
be thermodynamically homogeneous. The mean-field 
thermodynamics is well defined if the thermodynamic 
limit exists. Mean-field thermodynamic potentials must 
be thermodynamically homogeneous to make the ther- 
modynamic limit meaningful. Scalings in the phase 
space of mean-field models are nonlinear transforma- 
tions due to the volume dependence of the spin ex- 
change, therefore they are replaced by replications of the 
phase-space variables when testing thermodynamic ho- 
mogeneity. To introduce real replicas we use an iden- 
tity for integer v. [Tr e~ pH ] y = Tr,, exp j/3 £ H Q j = 

Tr„ exp j/3 £ (£. j J^SfSf + £ 2 Sf)\, where each 

replicated spin variable Sf is treated independently, i. e., 
the trace operator Tr^ operates on the z/-times replicated 
phase space. The free energy of a ^-times replicated sys- 
tem must be just z^-times the free energy of the non- 
replicated one. To test robustness of this property we add 
a small perturbation breaking the replica independence 
AH(fi) = J2iJ2 a <b ^ ab SfSi to allow replica-symmetry 
breaking in the system response to this disturbance. The 
perturbed free energy per replica reads 



1 1 

1 v 



In Tr c 



exp 



-f3AH(fi) 



(6) 



If the system is thermodynamically homogeneous and the 
equilibrium state stable, the result must be independent 
of the number of real replicas after switching off the per- 
turbation, that is 



zero. If the system is thermodynamically homogeneous 
then the limits n — ► and vn — * must produce the 
same results. We hence can introduce real replicas also 
in the replica trick to test thermodynamic homogeneity 
there 



III. MEAN-FIELD THEORY FOR 
n-COMPONENT SPIN GLASS MODELS 



Models with n independent spin components have the 
advantage that they can be treated in the same way as 
their replicated versions. The only difference is in the 
number of spin components and the way we perform the 
trace over spins. We hence will not specify the trace 
operator in this section and keep the result valid for all 
situations of interest. 

A mean-field theory is an approximation where the 
interacting part of the free energy is replaced by purely 
local terms. It can be achieved either by a volume- 
dependent scaling of a long-range exchange as in the SK 
model or we can consider the limit to infinite dimensions 
with appropriately rescaled short-range spin exchange in 
the Edwards- Anderson model. The best way to control 
a mean-field approximation is to employ a perturbation 
expansion in the spin exchange Jy . The mean- field con- 
tribution is then the leading nonvanishing order in the 
long-range or infinite-dimensional limit. It is easy to ver- 
ify that spins on distinct lattice sites interact in the mean- 
field solution of spin-glass models with the normalization 
of the spin exchange from Eq. Q only if connected by 
maximally squares of Jij. This property of the mean- 
field solution can be conveniently represented diagram- 
matically. Then only trees and simple loops in the spin 
exchange contribute. Trees represent an inhomogeneous 
Weiss mean-field while the loops stand for Onsager's cav- 
ity field. 



4- UmF v (n) = 



(7) 



This is a quantification of thermodynamic homogeneity 
of long-range, mean-field models. If this condition is ful- 
filled the thermodynamic limit and macroscopic quanti- 
ties are well defined. This is the eventual situation we 
would like to achieve also in spin-glass models. Equa- 
tion J7J must hold for the configurationally dependent as 
well as for the averaged free energy. 

Thermodynamic homogeneity expresses invariance of 
the thermodynamic limit, that is, invariance of the way 
the number of lattice sites becomes infinite. Both limits 
N — > oo and N' = vN — > oo generate the same macro- 
scopic equilibrium state in thermodynamically homoge- 
neous systems. Thermodynamic homogeneity can be for- 
mulated also in the replica trick, where is is equivalent 
to invariance of the limit of the number of replicas to 



Tree contribution 



Tree contributions in the diagrammatic expansion for 
the free energy lead to local magnetizations as thermally 
averaged values of spin variables. We write 



Si = Mi + SS, 



(8) 



where M< = Tr a [S t p\, p = exp{-/3H}/Z, Tr s [p] = 1,. is 
the local magnetization and SSi is the fluctuating part of 
the spin vector. We rewrite the free energy as a contri- 
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bution from local magnetizations and fluctuating spins 



^mTr, s 



exp I — ^2 JijSSi ■ 5Sj 



(9) 



where the trace is taken only over spin fluctuations 
around their thermal averages. Hence, Trss[5Sip] = 0. 
The Weiss mean-field solution is obtained from Eq. 10 
if the quadratic term in spin fluctuations is neglected. 
Since Jfj cx iV _1 we cannot neglect correlations between 
fluctuating spin components in spin-glass models. 



B. One-loop contribution 

To derive the leading loop corrections to the inhomo- 
geneous Weiss mean field we reformulate the problem in 
Gaussian fluctuating fields. We can represent free energy 
© with Gaussian fluctuating fields as follows 

F = -^J2 J »Mi ■Mj-H-Y, Mi + i In Z 



In 



Tr SS exp ^ 5§i ■ + (3H + ^ pJ t] M 3 



(10) 



where Z = /L>$exp| ., w 
Ylillaf^dQt/V^, and W = J- 1 



2 Z^17 1 



}, JD* = 

We use hats for 
operators (matrices) in the lattice space. Notice that the 
spin-exchange matrix J only with off-diagonal elements 
is not invertible. We, however, can introduce a suitable 
chemical potential —nSij to the spin exchange so that 
J K = —k + J is invertible. ft will become evident from 
the construction that the result at the end will be inde- 
pendent of this artificial chemical potential. 

Free energy <|10|) is difficult in that the trace over 
the spin fluctuations makes an effective potential for the 
Gaussian fields <&i complicated. The potential is, how- 
ever, local. The one-loop corrections to the Gaussian 
model can be incorporated in a local self-energy. This 
self-energy is generally a matrix in the spin components 
and we denote it q_ i . We underline matrices in spin in- 
dices. The local self-energy is calculated in a way similar 
to the cavity method. The procedure is called a general- 
ized coherent potential and was used to derive mean-field 



theories of quantum itinerant models ^iiThe one-loop 
free energy is that of a Gaussian model with an inhomo- 
geneous, site-diagonal potential g_ into which we embed 
coherently impurities with the medium potential g i re- 
placed by the actual local interaction of the random fields 
from Eq. IjlOjl • It is important that the embedding of im- 
purities is coherent. That is, the fluctuating fields are 
correlated via local elements of a renormalized exchange 
of the medium and the effect of the potential g i is locally 
the same as that of the active interaction. It means that 
if we remove a site i from the Gaussian model with a 
local potential g i and replace it with the local interac- 
tion between the fluctuating fields from the original free 
energy, there is no macroscopic change to be observed. 

To perform this task quantitatively we first renormal- 
ize the nonlocal correlation matrix W — > W — g_. Al- 
though the bare propagator W is diagonal in spin compo- 
nents, the self-energy, as an interaction- induced response 
to the symmetry-breaking term AH(/i) can become a 
nontrivial matrix in spin indices even after switching off 
the perturbation /j, ab — ► 0. We introduce local response 



matrices Ca = 



(W — <x) 1 containing the correlation 



between the local sites with fluctuating fields and the sur- 
rounding medium of the Gaussian model. Since we have 
to remove the potential g i at the active sites, the effec- 
tive exchange between the active locally fluctuating fields 
will be W — > C^ 1 + g t where the inversion is restricted 
to the chosen lattice site. The one-loop free energy then 
reads 



ij i 

+ Tr ln(l - gJ3J) - ^ ^ In J L>$ 

i 

xexpj-ll.^Jl+^r 1 *} 
Ttss explsSi - ($ + {3H + J2 PJijMj ) } . (11) 



All introduced local thermodynamic variables Mj, a i; 
and Cjfr enter the free energy as variational parame- 
ters and are determined from the respective stationarity 
equations^ 



We can now perform the integration over the fluctu- 
ating Gaussian fields <^ and return to the trace with full 
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spins. We obtain 



tion self-consistently as 



X 44 = <Li 



(14) 



— Trln(l — dj3J) + — E Trln[l + cr^C^] With this result the correlation function C u reads 



2(3 - 



^E ln Tr sex P | 



20 
1 =, 



Si AW + E " E.? + v^Mi 



(12) 



We can interpret the individual terms in the mean-field 
free energy (|12fl straightforwardly. The first term is the 
energy due to local magnetizations. The second term 
is a self-interaction of local magnetizations due to On- 
sager's cavity filed. The third term is the free energy of 
a Gaussian model with a potential g_. The fourth term 
is a subtraction of local sites from the Gaussian medium 
on which the spins interact with both the Weiss and On- 
sager's fields contained in the last term. 

Free energy (I12[l is an approximate solution where all 
tree and one-loop diagrams have been summed. Such 
an approximation becomes exact in the long-range limit 
with condition Q or in infinite dimensions with (J 2 j) a v = 
J 2 /2dr£ In this limit we can further simplify this repre- 
sentation, in particular the nonlocal contribution from 
the Gaussian model. We do it diagrammatically (ex- 
pansion in the spin exchange). Instead of summing the 
contributions from the spin exchange in the logarithm we 
find the mean-field form of the local correlation function. 
We have 



-— hx(l-aj3J) 



PJ(l-aj3J)- 



(13) 



Once we find an appropriate representation for the diag- 
onal elements of the correlation function C_ u we integrate 
it back to obtain a representation of the logarithm. 

We know that in the mean-field spin-glass model with 
Eq. |0J distinct lattice sites are connected by just two 
bonds Jfj. We then have to create couples of spin ex- 
changes in the expansion of C_ u to which we ascribe iden- 
tical lattice coordinates. When lattice sites i,j are inter- 
connected by Jfj there is no further correlation between 
these sites. If we fix one site index, the other one con- 
tributes only as an average over the lattice. Not to go be- 
yond the one-loop approximation, contractions connect- 
ing spin couplings with identical lattice coordinates must 
not cross and only contractions within contractions can 
take place (non-crossing approximation) . The self energy 
renormalized by all single loop contributions becomes a 
new vertex function. We can represent this renormaliza- 



e„:=E^4x, 



i-£»E^ 2 4x, 



(15) 



Using Eqs. (|14fl and (|15|l we obtain the mean-field limit 
of the nonlocal logarithm from Eq. 112J1 



Trln(l - afij) = \ E fJi^lZuZJ 



ETrln [l-a 



(16) 



where the first term on the right-hand side is a compen- 
sation for the CT-dependence of \. We can replace the 
nonlocal logarithm in Eq. l|12fl by the right-hand side 
of Eq. HI 6(1 . We then have to add the new local vertex 
functions X- to the variational parameters and obtain 
a mean-field free energy for multi-component spin-glass 
models. 

The phase space with thermodynamic parameters Mi, 
Hi i Q.U-, an d X u is unnecessarily large. We can explic- 
itly utilize the solutions of stationarity equations for a 4 
and C_ u so that all loop quantities are expressed only 
via the vertex functions x u - These equations are just 
Eqs. (|14fl and l|15|) . Moreover, we realize that the vertex 
functions X - appear in the free energy only in their av- 
eraged form and we can introduce new configurationally 

averaged loop parameters 2 J 2 x = 2~2i 1 JfiX - •■ Using 

— _ — 33 
all these simplifications in free energy l|12|l we finally end 

up with a generalized TAP free energy for n-component 

spin-glass models 

F = \ E JijMt ■ Mj — E Mi ■ 



f3J 2 
4 



NTr[xx\-^J2 ln 



Tr s exp i ^—Si ■ xSi 



0Si ■ \H + E JijMj - 0J 2 xM l 



(17) 



This mean-field free energy is very general and covers the 
vector spin models as well as replicated models used for 
investigation of thermodynamic homogeneity. 

It is straightforward to find that the saddle-point 
equation for the averaged vertex reads 



j I - M 3 M 3 



(18) 
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where the vectors on the right-hand side form a tensor 
(matrix) in spin components. From this equation we ob- 
tain the fluctuation-dissipation theorem for vector spin 
models 

3 

We see from Eq. <|18H that the averaged vertex \ is noth- 
ing but an averaged local susceptibility (up to the fac- 
tor j3). Only in the isotropic case with vanishing off- 
diagonal elements of \ we get rid of the local suscepti- 
bility as an order parameter in the TAP-like free energy. 
We, however, know that this is not the case either in 
vector models^ or in the replicated Ising spin glass^ 



separate diagonal and of-diagonal matrix elements of the 
local susceptibility. Due to the fluctuation-dissipation 
theorem we can represent \ aa = ( s n) 2 — N^ 1 ^2 i (M°') 2 . 
We further introduce the internal magnetic field as an 
independent random variable 

I?? = J2 JijK - M ? E 04 i 1 ( M /) 2 ) 

3 3 

-[3J 2 J2x ab M* . (22) 

b^a 

We add J^i Mi ■ ffi to free energy l|17|l and subtract the 
same term with rjf represented by Eq. (1221) . We obtain a 
new representation for the isotropic case 



C. Configurational averaging 

Free energy (|17f) has not yet the form of a typical 
mean-field representation, being standardly a single-site 
theory. To convert the spatially inhomogeneous free en- 
ergy to a single-site expression we have to average over 
the spin-exchange configurations. It cannot, however, be 
done without a few assumptions. First of all, we have 
to assume that the local magnetizations Mi and aver- 
aged susceptibilities \ describe uniquely thermodynamic 
equilibrium states. It means that we can find a set of 
these parameters with which the free energy is minimal. 
It is the case if the nonlocal susceptibility is nonnegative. 
That is, the second derivative 



5 2 (3F 
8M?5M b n 

1 J 



-PJijS a +5 r 









— « 



+ p z r x (20) 



has no negative eigenvalues. We denoted \ - the lo- 
cal susceptibility at site i. It is a matrix defined as in 
Eq. (|18|l but without averaging over the lattice sites. It 
is a straightforward task to find that the nonlocal sus- 
ceptibility, inverse of the matrix from Eq. (|20(l , has non- 
negative eigenvalues if a generalized de Almeida-Thouless 
(AT) condition is fulfilled 



(3 2 J 2 
N ^ 



det 1 



> 



(21) 



This inequality in fact stands for n conditions 1 > f3 2 J 2 Xf 
restricting each eigenvalue Xf,l = l,...,n of the aver- 
aged squared local susceptibility N^ 1 £\ x 2 ■ 

To average over the random configurations we have 
to assume that equilibrium states determined by the 
thermodynamic parameters from free energy l|17|) are 
non-degenerate. That is, solutions of the stationarity 
equations do not depend in the thermodynamic limit on 
boundary or initial conditions. This condition is essen- 
tially equivalent to thermodynamic homogeneity. Fur- 
ther on, we assume equivalence of individual spin compo- 
nents, that is H a = H and {{Sf) 2 ) T = s 2 - We then can 



a=l 



Vi 



f3J 2 
2 



1 

b^a ij a—1 

+(3J 2 (si - (M?) 2 ) (si - (m;) 2 )] 



^E ln 




Ti s exv\Y,St(l3H + H) 



(23) 



where apart from Mf and x ab & l so t ne fluctuating field 
r)f are variational parameters. 

One can prove with the assumptions mentioned at the 
beginning of this subsection that the internal magnetic 
fields Tjf are Gaussian random variables with covariance 



(24) 



The local Gaussian fields rjf are used to replace aver- 
aging over the nonlocal spin exchange To make the 
mean-field free energy explicit we have to simplify non- 
local terms explicitly dependent on the spin exchange 
Jij (only linearly) and terms with local random variables 
that are not manifestly Gaussian. Due to the Gaussian 
character of both the internal magnetic fields rjf and the 
the spin exchange Jy we obtain 



(M?v?)c 



E 



8Mf 



(25) 



and 



(JijMfM? 

_ J_ 

~ N 



3 ' av 
2 



SMf 

OJin 



+ 



SMI 

SJin 



M 3 



(26) 
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Further on, the nonlocal averaging decays into a product 
of local averages, since 



b 



(27) 



arrive at 



h = -^(1 - + —( 2 9 



With the above formulas we can average the free energy 
over random configuration so that only averaged site- 
independent order parameters remain. The averaged free 
energy is a sum of local terms only and we can go over 
to a free-energy density that, for n component isotropic 
spin-glass models, reads 



a=jib a=l 



In 



!o1 r2 n 
E x ab s a s b +pj2 sa ( H + r f) 



We denoted / Dr, = n" =1 dr) a /V2tt. 

The averaged free-energy density i|28|) is our starting 
point for the analysis of the role of two types of averaged 
order parameters: the overlap susceptibilities x ab an( l the 
overlap magnetizations q ab . They are determined from 
saddle-point (stationarity) equations 



q ab = (Tr s [p x S a ]Tr s [p x S b ]) r 
X ab = (Tr s [ Px S a S b ]) -q ab , 



(29a) 
(29b) 



where we denoted 



averaging over the random in- 



ternal magnetic field r\ and p x is the appropriate density 
matrix for thermal averaging over spin configurations. 
We remind that we assumed equivalence of individual 
spin components, that is q aa = qo and x aa = s n ~ Qo for 
a = 1, . . . ,n. 

In general n-component spin models, both parameters 
q ab and x a ^ b can become relevant in the low-temperature 
phase. To demonstrate this explicitly we resort our fur- 
ther analysis only to the replicated Ising spin glass with 
equivalent replicas, although there are no principal ob- 
stacles to extend the reasoning to more complex models. 



IV. TWO REAL REPLICAS 

Free energy l|28[l can be explicitly evaluated only if 
we fix the number of real replicas or components of the 
vector model. The simplest situation is the SK model 
with two equivalent real replicas, that is, the replicated 
spin space is isotropic. In this case we have (S a ) 2 = 1 



X) 



^ J In 2 {e + c+ 



+ e_c_} . (30) 



We set J = 1 in this expression and use this energy 
scale throughout the rest of the paper. Further on, 
we used an abbreviation for the Gaussian differential 



c+ = 



-072 



cosh 



/V27T and we denoted e± = exp{±0 2 x}, 
(2h + ^qo - q 2 /q a £1 + + q/ 7§b)$ 

(V<?o - q 2 /qa £1 - (^/qa - ?/\/9o)6 



c_ = cosh 

With the above notation we can write down the sta- 
tionarity conditions representing the equations for the 
averaged mean-field order parameters. 



9o 



(e+c+ + e-c-f 



(28) 



p 2 2 

e + s + 



e 2 _s 2 _ 



e_c_ 



X 



1 



( 2 2 

(+ - ; \(e +C+ + e_ C _) 2 



(31a) 
(31b) 
(31c) 



These equations have a solution qa = q and x = in the 
high-temperature phase. In the low-temperature (spin- 
glass) phase if 



O>l-0 2 ((l-t 2 12 )(l-t 2 )) 



then x > and 



> 1 - A0 2 



a-® 2 



+ e 2 _(l+t 



(32a) 



(32b) 



leads to A = qo — q > 0. We denoted ti = tanh/3(ft + 
6V5o) and t 12 = tanh/3(/i + S, lx /A(2q - A)/q + 
£2(^/qQ — A/^/qo). Hence, either of these parameters can 
become an order parameter in the spin-glass phase. We 
have to find which one is more relevant for thermody- 
namic stability. 

Numerical analysis and an expansion around the crit- 
ical temperature show that we cannot comply with both 
conditions i|32|) simultaneously. That is, either A > 
and the condition in Eq. Ij32a(l docs not hold (x = 0), 
or x > and then inequality l)32bjl cannot be satisfied 
(A = 0). If x — 0, the free energy does not depend on A 
and we recover the SK solution with q — and qo = qsx ■ 
Hence the only way to improve upon the SK solution is 
to choose x > and go = <?■ The free-energy density 
reduces in this case to 



f2R = -^(l-q? + ?f{2q + x) 



qo, q' 



q, and x a#h = X- It is then easy to _ J_ / £>£ m 2 [ e+ cosh(2/3(/i + ^)) + e_ 

calculate the trace over the replicated spin variables. We 2/3 J 



(33) 
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FIG. 1: Order parameters for the SK model at zero magnetic 
field with two real replicas compared to the SK parameter. 



FIG. 3: Instability of the two-replica and SK solutions in the 
spin-glass phase at zero magnetic field. 
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The second stability condition reads 
X = l~(3 2 (Xl(l-4) 2 ) 



> 



Xn=2 



[l-tj + el(l + f|)] 

[i + q + eUi-t 2 2 w 



(34a) 
(34b) 
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and is, on the other hand, always broken in the spin- 
glass phase. When compared with the AT condition of 
the SK solution, Fig. we can see that the two-replica 
solution deeper in the low-temperature phase is even less 
stable than the SK one. The two-replica solution must 
be modified to improve upon the instability of the SK 
averaged free-energy density. 



FIG. 2: Free energy of the SK model with two real replicas 
compared to the SK one. 



It is a straightforward task to solve stationarity equa- 
tions to functional l|33l) . The temperature dependence 
of the order parameters is plotted in Fig. ^ and of the 
free-energy density in Fig. 

Thermodynamics of the model with two replicas in- 
dicates some improvement upon the SK solution. The 
order parameter q = (mf) av is closer to the Monte-Carlo 
result Entropy at low temperatures is seen from Fig. [3 
to be less negative than that of the SK solution. However, 
the free energy is lower than the SK one, unlike Monte 
Carlo simulations. At zero-temperature the free-energy 
density has asymptotics f%R = — yj2/-K + T /An. It means 
that there is no change in the ground-state energy with 
respect to the SK result. The negative low-temperature 
entropy of the SK solution is halved with two replicas. 

The replicated solution must be unstable. A measure 
of instability is the generalized AT condition l|21|) . Since 
we have two replicas, this equation should stand for two 
conditions. One condition is the complement (negation) 
to inequality l|32b|) . It is satisfied at any temperature. 



V. ANALYTIC CONTINUATION - 1RSB 

The most straightforward improvement of the two- 
replica solution is its extension to an arbitrary number 
of equivalent real replicas. This can be done explicitly 
provided A = 0, that is, q ab = q. We show at the end 
of the next section that the condition for the instability 
leading to A > is never fulfilled for integer numbers of 
real replicas. We hence assume real-replicas with A = 0. 
The free-energy density then for a general matrix x ab 
reads 



J 71 . 



^X ab (x ab + 2q)-(l-q? 
oo ( 

±- J ^lnTr s exp It^X^S" 



+PY,S a (H a + r l ^) \ . (35) 



To evaluate explicitly this free energy we assume the 
replica-symmetric (isotropic) case, x ab = X f° r a b, and 
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decouple the interacting spins in Eq. I)35|l by a Hubbard- 
Stratonovich transformation linearizing the quadratic 
term in spin variables in the exponential. The trace over 
the spins can be performed explicitly for arbitrary num- 
ber of replicas and we obtain a free-energy density with 
n real replicas 



fn(q, x) 



If 00 

-^-1-xf + l - A n X {2 q + X )--J_V V 

xln/ V\{2coah\P(h + riy/q + \y/x)]} n (36) 



We can get rid of the A-integration from the Hubbard- 
Stratonovich transformation for any positive integer n. 
It is easy to verify that free energy l|36|l for n = 2 re- 
duces to Eq. (J2HJ). However, the integral representation 
of the free energy as used in Eq. (|36fl is indispensable 
for analytic continuation of the free energy with integer 
number of real replicas to an arbitrary real n. This con- 
tinuation is unique if the limit at |n| — > oo is analytic. 
The limit to infinite-many replicas exists with \ ~~ * x' l n - 
It reduces the A-integration to a saddle-point. Free en- 
ergy analytically continued to arbitrary number of real 
replicas is a fundamental tool for investigating thermody- 
namic homogeneity of the solution. According to Eq. Q , 
thermodynamically homogeneous free energy should not 
depend on the replication parameter n. 

We already know that free energy l|3t)[> depends on the 
number of real replicas. The solution cannot hence be 
thermodynamically homogeneous whatever n we choose. 
We, however, can use the analytically continued free en- 
ergy (|36[) to minimize its inhomogcneity. This minimiza- 
tion is achieved by vanishing of the local dependence of 
the replicated free energy on the replication factor n. 
That is, we demand 



dfn 

dn 



= 



(37) 



This equation determines the optimal choice of n for 
which the deviation from thermodynamic homogeneity 
of the free energy is minimal. 

Equation l|37|l has always a solution. It is easy to 
verify that f = fi = fsKi whereby for n = 1 the free 
energy does not depend on \ an d for n — we have 
Isk = q + X- Hence, there is an n eq 6 [0, 1] for which 
Eq. (|3"TI) is fulfilled. Moreover, since /„ < fsK for n> 1 
and n < 0, see Fig 0] the solution with the minimal 
deviation from thermodynamic homogeneity maximizes 
the free energy as a function of the replication factor n. 

Free energy (|36H with the optimized replication pa- 
rameter n via Eq. I|37|l is identical with the Parisi 1RSB 
solution. It significantly improves upon the SK solution 
in the spin-glass phase. The free energy is higher than 
the SK one everywhere below the critical point, Fig. 
Notice that optimization of the replication parameter n 
via Eq. j!T7|l is a very important constituent of the RSB 
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FIG. 4: Dependence of the averaged free-energy density on 
the replication parameter n at T = T c /4. 



-0.75 




FIG. 5: Free-energy density for the optimized replication pa- 
rameter compared to the SK solution. 



solution. In particular in low temperatures. The RSB 
solution improves upon the ground-state energy at zero 
temperature only if the parameter n depends on temper- 
ature. Only if the optimal replication parameter scales 
with temperature as n — Tv we obtain nonvanishing 
overlap susceptibility x a ^ zero temperature, Fig. El being 
responsible for a remarkable improvement in the ground- 
state energy toward the Monte-Carlo result. 

With n = Tv we can derive an explicit representation 
for the zero-temperature free energy 

f=- V -{l-q) 2 -\Jvi 1 \nA{ V ^, q ) (38) 

where we denoted 



A(r), v, q) 



e -"W?erfc (-V^/T~q + T)y/q/(l-q)) 
+ e' y "^erfc (-v^l^ ~q - Vy /q/(l- q)} 



(39) 
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FIG. 6: Order parameters for 1RSB and two real replicas. 
We denoted the Parisi parameter Q = q + X- The importance 
of optimization of the replication parameter at low tempera- 
tures is demonstrated on the behavior of the overlap suscep- 
tibility x- 

We used the error function erfc(a;) = f°° e"* 2 l 2 dt/ y/ir. 
The stationarity solution of the zero-temperature free en- 
ergy can be numerically evaluated rather accurately. We 
obtain q = 0.477 ± 0.001, v = 1.351 ± 0.001, and / = 
-0.76526 ± 0.00001. Theory with a fixed number of real 
replicas leads at low temperatures for whatever fixed n 
(integer or noninteger) to a solution with x = T\/2/ir/n, 

q = 1 - X , and f n = f SK = -y/2pir + T/2nir « -0.798 
as found in the preceding section for n = 2. 

VI. STABILITY AND HIERARCHICAL 
ORGANIZATION OF ORDER PARAMETERS 

Although the 1RSB solution improves upon the SK 
results toward the outcome of Monte-Carlo simulations, 
it is the stability condition i|21|) that decides whether this 
could be a final form of the mean-field free energy of 
the SK model. One-step RSB solution was derived from 
Eq. (|35[) with an isotropic or replica-symmetric ansatz 
on the overlap susceptibilities. The stability condition in 
this case breaks into two inequalities for two eigenvalues 
of this solution. 

A generalization of the AT stability condition l|34fl for 
arbitrary replication number reads 

A = 1 - P 2 ( [1 - (1 - n)( Pn t 2 ) x - n(p n t)l] 2 ) > . 

" (40a) 

We abbreviated t = tanh \/3{h + rj^/q + Xy/x)] , 
(X(X))x = JZoVX X(X) and p n 

cosh" [p(h + vVq + xVx)] I (cosh" [p(h + vVq + tyx)] ) 

Inequality 140a() actually stands for the maximal eigen- 
value of the square of the local susceptibility with 
the replica-symmetry ansatz. The other eigenvalue is 
«P„(l-t 2 ))i>„. 



FIG. 7: Instability parameters from the 1RSB solution com- 
pared with the SK one. 

There is another significant stability condition for the 
multicomponent spin-glass theory. It, however, cannot 
be derived from the TAP approach and the generalized 
AT condition H21|) . The second stability condition is a 
generalization of expression l|32bfl from two replicas and 
reads 

Ai - 1 - P 2 ((pn (1 - * 2 ) 2 ) A ) ?; > ■ W 

It expresses stability of the replica-symmetry ansatz 
on the matrix of the overlap susceptibilities. Should 
the replica-symmetric solution be stable, both condi- 
tions (|40|l must be obeyed. 

To assess the stability conditions quantitatively, we 
first evaluate the low-temperature solution near the crit- 
ical point. There we expand in 9 = 1 — T/T c with 
T c = 1. The 1RSB solution reduces to q = 6/3, 
X = 29/3, n = 46/3, and q EA = q + x = 6 + 256» 2 /27. 
Both equations (|40|l show the same # — > asymptotics: 
A = Aj = -46 2 /27. On the other hand, the SK 
solution in this asymptotic limit reduces to (mf) av = 
6 + 6 2 /3, (mf) = 3d 2 . The AT instability then is 
A = 1 - (1 - 2<m?) 00 + (mf> ao )/(l - 0) 2 = -49 2 /3. 
The instability of the 1RSB solution is one order smaller 
than the instability of the SK one, but nevertheless it 
is not yet the final mean-field theory. The full tempera- 
ture dependence of the the two instability conditions is 
plotted in Fig. We can see an overall significant im- 
provement upon the AT instability of the SK solution in 
the spin-glass phase. 

The 1RSB solution, that in this formulation is a 
replica-symmetric form of free energy l|35|l . is unstable 
and hence the isotropic ansatz on the matrix x ab was 
not quite accurate. With the replica-symmetric ansatz 
we improved upon the instability of the SK solution but 
have not yet reached the global thermodynamic homo- 
geneity of the averaged free energy. To find a stable 
mean-field theory satisfying the generalized AT condi- 
tion lj2*Tl) we should go beyond the isotropic ansatz on 
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FIG. 8: Dependence of the stability parameters Ao and Ai 
on the replication parameter n at T = T c /4. The optimized 
(equilibrium) parameter n eq for this temperature is marked. 



the matrix of the overlap susceptibilities x ab ■ We can try- 
to make another, less apparent ansatz. It is not, how- 
ever, a simple way, since there are several restrictions we 
have to comply with. First, there is no other solution ex- 
cept for the replica symmetric one for n > 1. Hence, one 
has to analytically continue the averaged free energy to 
the number of replicas less than one. Second, the num- 
ber of replicas must be a dynamical variable dependent 
on the thermodynamic input parameters, temperature 
and external magnetic field. Otherwise we would not im- 
prove upon the ground-state energy of the SK solution 
at zero temperature. Parisi proposed an ansatz in the 
effort to maximize the free energy. To avoid ansatzes, 
the physical meaning of which is not quite clear, we can 
proceed as outlined in Ref. 14. The fundamental idea 
of this construction is a hierarchically applied replication 
of the phase space with the replica symmetric ansatz on 
the matrix of the overlap local susceptibilities at each 
step (replication). Replication of the phase-space vari- 
ables actually checks whether the solution is thermody- 
namically homogeneous. Since the 1RSB substantially 
improved upon the SK solution, we can expect a rapid 
convergence toward a globally thermodynamically homo- 
geneous solution in this way. 

We first replicate the spin variables in Eq. We 
do it so by replacing n — > mri2 and testing homogene- 
ity of the free energy f ni with respect to the 72,2-times 
enlarged (replicated) phase space. With the new scal- 
ing we have to replicate each spin variable S a to (S a ) a 
and transform the matrix of overlap susceptibilities to a 
super matrix x ab ~^ (x a P) ab where a, b = 1, . . . , rii and 
a, j3 = 1, . . . , 712- Since all spin variables S a are thermo- 
dynamically equivalent, they have to split into new states 
labeled by the new replica index a identically. 

The mean-field equations for the new matrix (x a ^) ab 
contain a replica-symmetric solution xi = (x a ^) ab f° r 
a 7^ b and X2 — [x af> ) aa for a 7^ (i. The super- 



diagonal matrix element (x aa ) aa is determined from the 
fluctuation-dissipation theorem and is not an order pa- 
rameter. If the newly won free energy with q, xi an d X2 
physical order parameters and ri\ and ni replication pa- 
rameters does not depend on n.2 for q, xi and n\ from the 
1RSB solution, the free energy is then globally thermo- 
dynamically homogeneous. We, however, already know 
that it is not the case for the SK model and the free en- 
ergy depends on n^. We again employ the minimization 
of thermodynamic inhomogeneity by demanding vanish- 
ing of the n 2 -dependence locally. We recover the 2RSB 
solution. We continue in this hierarchical construction so 
many times till we reach independence of the free energy 
of the last replication parameter. The full RSB solution 
of Parisi with infinite-many hierarchical levels for the SK 
is thereby recovered. 

It is worth noting how the stability conditions (|40|l are 
related to the generation of new order parameters in the 
higher level of the RSB scheme. If the 1RSB solution is 
unstable, then the new order parameter X2 may emerge 
in two ways. First, if the factor Ao from Eq. (|40a|l is 
negative and Ao < Ai then xi peels off from zero and 
Xi > X2 > 0. That is, the new order parameter X2 is 
the smallest one. If the other parameter Ai < has 
the largest negative value then X2 peels off from xi and 
X2 > Xi > 0. Note that the overlap susceptibility xi 
from the 1RSB solution changes its value in the 2RSB 
solution with nonzero xi and X2- 

The solution is thermodynamically homogeneous only 
if both conditions (|4*U)l are obeyed. We can see in Fig. |H] 
that for the equilibrium replication parameter n eq both 
conditions are actually broken in the SK model. We can 
also see in Fig. [8] that parameter Ai is always positive 
for the replication index n > 1 and hence the overlap 
magnetizations do not split from its diagonal value q ab = 
q aa for integer n. Moreover, subsequent replications of 
solutions with a fixed (integer) number of real replicas 
do not lead to real splitting of the overlap susceptibilities 
and we have xi — X2 at the 2RSB level without analytic 
continuation to n < 1. 



VII. INTERPRETATION OF THE 
REPLICA-DEPENDENT ORDER PARAMETERS 

An attractive feature on real replicas in the thermo- 
dynamic approach of Thouless, Anderson, and Palmer as 
used in this paper is a possibility to avoid a complicated 
route of averaging over randomness via weighted contri- 
butions from different metastable TAP sates, solutions 
of the TAP equations, suggested in Ref. |2jJ Here we 
treat the replicated system at low temperatures as if it 
were in the high temperature phase. The order parame- 
ters, introduced as a response of the system to infinitesi- 
mal symmetry-breaking fields, are hence assumed to de- 
termine uniquely the equilibrium thermodynamic state. 
The price we pay for this is an extension of the phase 
space and involving the replicated spin variables in the 
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description of the equilibrium state of the original (non- 
replicated) system. To complete the construction of the 
mean-field theory with real replicas we have to provide 
a physical interpretation of the replica-dependent order 
parameters. 

Having an integer number n > 1 of replicas of 
the original spin systems means that we formally have 
n copies of the thermodynamic system where different 
copies are distinguished by e.g. an external magnetic 
field. We assume infinitesimal differences in the mag- 
netic field in different replicas. The local magnetization 
from the ath replica is nii(h a ). The magnetic fields are 
kept different for finite volumes but acquire the same 
value for all replicas after the thermodynamic limit has 
been performed. The overlap magnetizations then are 
q ab = \im h a h b_ h (mi(h a )mi(h b )} av . This is the standard 
way how real replicas are understood i 21 ' 22 That is, we as- 
sume that different thermodynamic states with slightly 
different thermodynamic parameters cannot be averaged 
independently. 

In this paper we argued that not only configurational 
averaging cannot be performed independently for slightly 
different macroscopic parameters but also thermal aver- 
aging of different spin replicas cannot be performed sep- 
arately from each other. Spin values S b from a system 
replica b influence the local magnetic field in a system 
a / i via the overlap susceptibility h ab = x Ther- 
modynamic states in one replica are then influenced by 
spin configurations in the other system replicas. Num- 
ber n then determines how many different replicas we 
take into consideration. 

If thermodynamic states in one replica depend on spin 
configurations in other replicas, it means that thermody- 
namic states calculated within one isolated replica are 
unstable and are not uniquely determined. To achieve a 
stable equilibrium state we have to reach independence 
of phase-space replications. Independence of the replica 
index n cannot be reached within the set of integer num- 
bers. Stability conditions for systems with broken in- 
dependence of individual thermodynamics in replicated 
systems indicate that n > 1 does not remove the insta- 
bility of the non-replicated SK solution. 

It appears that the only way to improve nontrivially 
upon the instability of the non-replicated solution in the 
real-replica approach is to analytically continue the repli- 
cated theory to noniteger replication factors n < 1. It 
cannot, however be done for arbitrary matrices q ab and 
X ab ■ We hence used the replica-symmetric result from 
integer numbers, q ab — q, x a ^ b = X- Such an analytic 
continuation is then uniquely defined and we can analyze 
the solution for arbitrary real n. We find that the aver- 
aged free energy density has a maximum for some equi- 
librium value n eq € [0,1]. This maximum corresponds 
to a locally homogeneous solution, that is, to a solution 
whose dependence on the replication index is minimized. 
This is also the point at which we maximally improve 
upon the SK result. The solution with the optimized n eq 
coincides with the 1RSB level of the Parisi scheme. 



The replication parameter n < 1 gives the real repli- 
cas another meaning than do integer values. If < n < 1, 
the replication parameter can have only a probabilistic 
meaning. We know that the mean-field free energy de- 
pends on the replication number n if the AT condition 
is broken and the TAP equations have many metastable 
(composite) states, saddle points in the free energy. They 
depend on initial/boundary conditions. Since the macro- 
scopic thermodynamic state is described only by macro- 
scopic parameters, it must be in a way averaged over all 
different microscopic realizations. It means that we ob- 
serve in thermodynamic equilibrium only states averaged 
over the initial conditions. 

If solutions of mean-field (TAP) equations depend on 
initial conditions, the powers of configurationally depen- 
dent variables (local magnetizations) are not uniquely 
defined. We have to introduce an additional averaging 
over the initial conditions in the TAP approach, i. e., av- 
eraging over spin configurations from which we started 
equilibration. We hence have to distinguish (m 2 )™ from 
(mi)f ni , where the angular brackets denote averaging 
over the initial conditions. To perform averaging over 
the initial conditions properly, we have to weight the 
initial spin configurations with the corresponding Boltz- 
mann factor. In our approach we simulated the weighted 
averaging over initial conditions by replicating the spin 
variables subject to the same thermal equilibration as the 
dynamical spins. The replication parameter < n < 1 
then expresses the probability to find two local magneti- 
zations at the same site with different values when vary- 
ing the initial conditions. Such an interpretation has ori- 
gin in a decomposition of the local susceptibility 

X, i = (l-n)(l-(t 2 ))+n(l-(t i ) 2 ) , (41) 

where U — tanh/3(/i + X^/x + Vi) i s the instantaneous 
local magnetization and the angular brackets denote av- 
eraging over the internal field A, that in our formu- 
lation stands for the weighted averaging over initial 
conditions. Definition l|41|l manifests violation of the 
fluctuation-dissipation theorem in situations with several 
possible values of local magnetizations for TAP macro- 
scopic states. The boundary value of the replication 
parameter n = corresponds to separated metastable 
states (infinite energy barriers between individual states) . 
The other boundary n = 1 leads to a completely ran- 
dom situation with indistinguishable states (single TAP 
state). In both limiting cases we reproduce after averag- 
ing the SK solution. 

Essential part of the construction of a stable solution 
of mean-field spin-glass models is minimization of ther- 
modynamic inhomogcncity. The stable solution should at 
the end be thermodynamically homogeneous, that is, in- 
dependent of the initial conditions. Independence of ini- 
tial conditions is marked by independence of the replica- 
tion factor n. If the stationarity points of the mean-field 
free energy depend on initial conditions, thermodynamic 
homogeneity is achieved by an optimal organization of 
different solutions of the mean-field equations. This or- 
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ganization is reflected in the structure of the matrix of 
overlap susceptibilities. We do not know it a priori and 
have to assume it. 

In this paper we discussed only the replica-symmetric 
choice of the matrix of the overlap susceptibilities x a ^ b — 
X- With this ansatz we assume structureless organization 
of different solutions of the mean-field equations. One 
can disclose an organization of different solutions leading 
to globally homogeneous solution by successive replica- 
tions with the replica-symmetric ansatz as proposed in 
Ref. 0. At present we, however, do not know whether 
in this way resulting discrete RSB solution of Parisi is 
the only thermodynamically homogeneous macroscopic 
state. 



VIII. CONCLUSIONS 

We studied in this paper the genesis of the nontriv- 
ial structure of the order parameters in the RSB solu- 
tion of the SK model. We derived a thermodynamic 
mean-field free energy for typical configurations of the 
spin exchange for general vector spin-glass models. In 
this expression naturally two types of order parameters 
emerge. They are the local magnetizations mf and the 
averaged local susceptibilities x ah ■ We used this free en- 
ergy to analyze a replicated SK model. We found that 
due to the existence of many saddle points in the TAP 
free energy the local magnetizations depend on the ini- 
tial conditions from which we start thermal equilibra- 
tion. Due to this fact, powers of the local magnetiza- 
tion are nontrivially correlated. We concluded from our 
results that this correlation is caused by non-negligible 
dependence of thermodynamic states (solutions of the 
TAP equations) on fluctuations in the initial conditions 



rather than due to fluctuations in the configurations of 
the spin-exchange Jy. Hence, the Parisi matrix of order 
parameters Q ab = q ab + x ab becomes nontrivial because 
the overlap susceptibility x a ^ b nas a complicated internal 
structure. The disorder-induced correlation between the 
local magnetizations q ab = N^ 1 J2i rn i m i = Q remains 
structureless in both high- and low-temperature phases. 

With our analysis we demonstrated that replication 
of the phase space is a useful tool for investigating ther- 
modynamic homogeneity of mean-field free energy for 
a variety of spin models with or without randomness. 
Besides that, when replications are applied successively 
together with equivalence of replicas and the replica- 
symmetric ansatz it offers a systematic hierarchical con- 
struction converging to a globally thermodynamically ho- 
mogeneous solution. A substantial ingredient of this con- 
struction is analytic continuation to arbitrary number of 
real replicas and subsequent minimization of thermody- 
namic inhomogeneity if it occurs. If a particular solution 
does depend on the replication index, i. e., it is inhomo- 
geneous, we have to choose such a replication parameter 
at which the free-energy dependence on it is minimal. 
The optimized free energy is independent of infinitesimal 
changes of the replication index. In this way we fully re- 
construct the replica-symmetry breaking solution of the 
Ising spin glass. 
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